MULTI-DIMENSIONAL STOCHASTIC SINGULAR CONTROL VIA 
DYNKIN GAME AND DIRICHLET FORM 



YIPENG YANG * 

Abstract. The traditional difficulty about stochastic singular control is to characterize the 
existence and regularities of the value function and the optimal control policy. In this paper, a multi- 
dimensional singular control problem is considered. We found the optimal value function and the 
optimal control policy of this problem via Dynkin game, whose solution is given by the saddle point 
of the cost function. The existence and uniqueness of the solution to this Dynkin game are proved 
through an associated variational inequality problem involving Dirichlet form. As a consequence, the 
properties of the value function of this Dynkin game implies the smoothness of the value function of 
the stochastic singular control problem. In this way, we are able to show the existence of a classical 
solution to this multi-dimensional singular control problem, which was traditionally solved in the 
sense of viscosity solutions. Q 
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1. Introduction and Problem Formulation. The one dimensional optimal 
stopping problem has been thoroughly studied, see, e.g., Dayanik and Karatzas [3], 
Gapeev and Lerche [8] . Given a symmetric Markov process on a locally compact sep- 
arable metric space, it is well known that the solution of an optimal stopping problem 
admits its quasi continuous version of the solution to a variational inequality problem 
involving Dirichlet form, e.g., see Nagai [HI. Zabczyk [T7] extended this result to a 
zero-sum stopping game, also known as Dynkin game. In the one dimensional case, 
the integrated form of the value function of the Dynkin game was identified to be 
the solution of an associated stochastic singular control problem, e.g., see Taksar [T5] , 
Fukushima and Taksar [BJ. As a result, the classical smooth solution can be obtained 
for this singular control problem other than the viscosity solution techniques [1] [2] [T] . 
The approach to solve singular control problems through variational inequalities and 
Dynkin game can also be found in Karatzas and Zamfirescu [12], Guo and Tomecek 

m- 

In the one dimensional singular control problem, each point in the space has a 
positive capacity ([BJ), hence the nonexistence of the proper exceptional set. However, 
this is no longer the case in multi-dimensional singular control problem. This paper is 
an extension of the work by Fukushima and Taksar [BJ to multi-dimensional stochastic 
singular control problem. We overcome this difficulty using the absolute continuity of 
the transition function of the underlying process [7] . 

In this paper, we are concerned with a multi-dimensional diffusion on R n : 
(1.1) dX t = n(X t )dt + a(X t )dB u 
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X*= : ,/i(X t )= : \.mX,) 

\ -X"nt / \ Vr, 

(1-2) ^ 

in which fii,a-ij (1 i ^ n, 1 ^ j ^ m) are functions of Xi t , X(„_ 1 ) t , and 
B t is m-dimensional Brownian motion with m ^ n. Thus we are given a system 
(f2, J 7 , Ttt X, #t, P x ), where is a measurable space, X = X(w) is a mapping 

of into C(R"), Ft = ct(X s ,s ^ t), and 9 t is a shift operator in Q, such that 
X s (9tu>) — X s+t (w). Here P x (x £ M. n ) is a family of measures under which {X t , t ^ 0} 
is an n-dimensional diffusion with initial state x. 
We assume the following usual conditions: 
Assumption 1.1. There exist constants C and D such that 

|/i(x)| + |a(x)| <C(l + |x|), xel": 



\n(x)-n(y)\ + \*(x)-(r(y)\^D\x-y\, x,yel". 
A control policy is defined as a pair 

(4 X \4 2) ) =S oiT t adapted processes which 
are right continuous and nondecreasing in t and we assume A^\ are nonnegative. 
Denote S the set of all admissible policies, whose detailed definition will be given in 
Section 01 

Given a policy S = (A^, A[ 2) ) g § we define the following controlled process: 
dX u = n\dt + andB u H h crx m dB mU 

dX nt = n„dt + VnidBit H h a nm dB mt + cL4 t (1) - dAf\ 

X = x, 

with the cost function 

(POO poo 
J e- at h(X t )dt+ I e^*(/ 1 (X t )d4 1) +/ 2 (X t )d4 2) 

(1.4) /i(x),/ 2 (x) >0, VxeR". 

Here we assume A^ — A^ is the minimal decomposition of a bounded variation 
process into a difference of two increasing processes. 

There are two types of costs associated with the process Xt for each policy <S. 
The first one is the holding cost /i(X t ) accumulated along time. The second one is 
the control cost associated with the processes {A^\ a\ 2 '), and this cost increases only 
when (ifUf') increase. 

One looks for a control policy S that minimizes /cs(x), i.e., 

(1.5) W(x) = minfc <s (x). 

ses 

As an application of this model, a decision maker observes the expenses of a 
company under a multi-factor situation but only has control over one factor, yet 
she still wants to minimize the total expected cost. Analogously, by studying the 
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associated maximization problem, i.e., taking the negative of min, this model can be 
used to find the optimal investment policy where an investor observes the prices of 
several assets in a portfolio but could only adjust one of them. 

The rest of this paper is organized as follows: we first introduce some preliminaries 
on Dirichlct form and a variational inequality problem in Section [2] In Section [3] we 
identify conditions for the value function as well as the optimal policy of the associated 
Dynkin game. The integral form of the value function of this Dynkin game is shown 
in Section U to be the value of a multi-dimensional singular control problem, and the 
optimal control policy is also determined consequently. 

2. Dirichlet Form and a Variational Inequality Problem. Let X be a 

locally compact separable metric space, m be an everywhere dense positive Radon 
measure on X, and L 2 (X, m) denotes the L 2 space on X. We assume that the Dirichlet 
form (£, JF) on L 2 (X, m) is regular in the sense that & Pi Co(X) is £\ dense in & and 
is uniformly dense in Co(X), where the £\ norm is defined as follows: 

■ 1/2 

\ u \\£i — [£(u,u) + J u(x) 2 m(dx) 
Analogously we define £ a (u, v) as £ a (u, v) — £{u, v) + a(u, v) (a > 0), where 

(it, v) = / u(x)v{x)m(dx). 



In this case (£, is called regular [5]. 

For this Dirichlet form, there exists an associated Hunt process M = (X t ,P x ) on 
X, see [5], such that 

ft /(x) := £ x /(X t ), x e X 

is a version of Ttf for all / G Cq(X), where Ti is the L 2 semigroup associated with the 
Dirichlet form (£,#"). Furthermore, the L 2 -resolvent {G ai a > 0} associated with 
this Dirichlet form satisfies 

(2.1) G a f G JT, £ a (G a f, u) = (/, u), V/ G i 2 (X; m), Vu £ 

and the resolvent {R a , a > 0} of the Hunt process M given by 

R a f(x) = E x (J™ e- at f(X t )dt)j , x G X, 

is a quasi-continuous modification of G a f for any Borcl function / G i 2 (X; m). 

For a > 0, a measurable function / on X is called a-excessive if /(x) and 
e _a Vt/( x ) t /( x ) as t I for any x G X. A function / G & is said to be an a- 
potential if £ a (f,g) > for any with g ^ 0. For any a-potential / G define 

/(x) = limtj.opt/(x), then f — f m-a.e. and / is a-excessive (see Section 3 in [7]). / 
is called the a-excessive regularization of /. Furthermore, any a-excessive function is 
finely continuous (see Theorem A. 2. 7 in [5]). 

Let fi , ji G & be finely continuous functions such that for all x 6 X 



(2.2) 



- A(x) < / 2 (x), |/i(x)| < #x), |/ a (x)| < V(x), 
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where <fi, ip are some finite a-excessive functions. We further define the set 

(2.3) K = {u e & : -fi^u^ / 2 , m-a.e.}. 

For a given continuous and bounded function H G £ 2 (X; m) one looks for a solution 
y £ K to the following variational inequality problem 

(2.4) £ a (V,u-V)^{H,u-V), VueK. 

Here we can see R a H (hence G a H) is also a bounded function. 

As related literature, Nagai [14] considered an optimal stopping problem and 
showed that there exist a quasi continuous function w £ j£" which solves the variational 
inequality 

to — /l, £ a (w, u — w) ^ 0, Vtt <E J? with m ^ — /i, 
and a properly exceptional set N such that for all x £ X/N, 

u;(x) = sup£ x (e-^h/ipC)]) = £ x (e-^h/ipC*)]) , 

a 

where 

a = inf{i^O;u;(X t ) = -/ 1 (X t )}. 

Moreover, w is the smallest a-potential dominating the function — /i m-a.e. 

Zabczyk |17j then extended this result to the solution of the zero-sum game- 
also called Dynkin game-by showing that, there exist a quasi continuous function 
V(x) £ K which solves the variational inequality 

(2.5) £ a (V,u-V) > 0, VueK, 
and a properly exceptional set N such that for all x £ X/N, 

(2.6) ^( x ) — SU P i n f ^x(T) o") = inf sup J x (r, a) 

(J T T fj 

for any stopping times r and cr, where 

(2.7) J x (t,<t) = £ x ( e - Q (^-) (-7 (T<T /i(X (T )+/ T<CT / 2 (X T ))) . 
Let 

£i = {x£ X/N : V(x) = -/i(x)}, £ 2 ={xe X/N : V(x) = / 2 (x)}, 
then the hitting times f = te 2 , cr = te 1 is the saddle point of the game 

(2.8) J x (f,(r) < J x (f,<7) < J x (r,<r) 

for any x £ X/N and any stopping times r, cr, where J x is given in (|2.7|) . In particular, 
the value of the Dynkin game is given by 

(2.9) V(x) = J x (f,a), VxeX/N. 
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Fukushima and Menda [7 showed that, if the transition function of M satisfies 
an absolute continuity condition, i.e., 

(2.10) p t (x,-) «m(-), 

for alH > and x G X, and f\ , f2 satisfy the following separability condition: 
There exist finite a- excessive functions V\, i>2 G & such that, for all x G X. 

(2.11) - /i(x) < Wl (x) - wa(x) < / 2 (x), 

then Zabczyk's result still holds and there does not exist the exceptional set N. The 
following is a version of Theorem 2 in . 

Theorem 2.1. Assume conditions (2. Sty . k2.10\) and k2.11\) . There exists a finite 
finely continuous function V satisfying the variational inequality \2. 5\) and the identity 



y(x) = sup inf J x (t, a) — inf sup J x (t, cr), Vx E X, 

where <r, r range over all stopping times. Moreover, the pair (f, a) defined by 
t = inf{t > : V(X t ) = / 2 (X t )}, a = inf{t > : V(X t ) = -/i(X t )}, 
is the saddle point of the game in the sense that 

Jx(t,<t) < J x (f,a) < J x (r,&), VxgX, 

/or a/Z stopping times r, c 

In the case -ff 7^ in (|2.4I) . we have the following proposition: 

Proposition 2.2. There exists a unique finite finely continuous function V G K 

which solves \2.J$ . 

Proof. For the case H = 0, by Theorem 12.11 there exists a finite finely continuous 
function V G K such that 

(2.12) £ a (V, u - V) > 0, Vu G A'. 
From (12.12[) we have 

5a(V,tt) >£ a (V,V) >0. 

By Cauchy-Schwarz inequality, 

S a (u,u)S a (V,V) >£l(V,u), 

and this implies 

(2.13) S a (u,u)>€ a (V,V). 

Conversely, suppose (|2.13p holds, and define w = u — V for an arbitrary u G K . Since 
K is convex, it can be seen that 

V + ew = (l-e)V + ett G K, Ve G (0, 1). 

Thus HHT5D gives 

e a (y, V) < £ a {V + ew, V + ew), 
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or equivalently 

< 2£ a (V,w) + e£ a (w,w). 

By letting e^Owe get (j2T2]) . 

By virtue of the closedness and convexity of the set K, we conclude that (|2.13|) 
(or equivalently (|2.12p ) has a unique solution. 

Now for a nonzero H in (|2.4p . because H is continuous, (|2.ip implies that G a H 
is a continuous and bounded function. Define hi = fx + G a H, I12 = fi — G a H, then 
by the conditions on H in (12.41) and the conditions on fi , f 2 in (|2.2I) , it can be seen 
that hi,fi2 are finite finely continuous functions. Let 

(2.14) K° = {u G J*"; -/ii < it ^ /i 2 , m-a.e.}, 
and V° = V ~ G a H, then it can be concluded that 

(2.15) ^(^V-F ) ^ 0, Vti£i( 
has a unique solution. (|2.15p implies 

£ a (V ~ G a H, u - G a H - (V - G a H)) ^ 0, Vtie K, 

which can be reduced to (|2.4p by virtue of (I2.ip . □ 
We assume the following separability condition: 

Assumption 2.1. There exist finite a-excessive functions ui,«2 € & such that, 
for all xeX, 

(2.16) - A(x) - G a H( x ) < Wl (x) - wa(x) < / 2 (x) - G a ff(x), 

then the following results holds: 

Theorem 2.3. For any bounded and continuous function H given in \2.J$ and 
for any satisfying K2. 2\) 112.16)) . we put 

(2.17) J x (r,a) ^ A e - Qt i/(X 4 )d^ 

(2.18) +£ x (V"^) (-J a<r /i(X ff ) + J T<ff / 2 (X T )) 



for any stopping times r, a . Then the solution of \2. 3\) and {2.J$ admits a finite finely 
continuous value function of the game 

(2.19) ^( x ) = inf sup J x (r, u) = supinf J x (t, a), Vx G X. 

Furthermore if we let 

Eh = {x G X : V(x) - -/i(x)}, £ 2 ={xeX: V(x) = / 2 (x)}, 
then the hitting times f = te 2 , <J = te 1 is the saddle point of the game 

(2.20) J x (f, o) < J x (f , a) < J x (r, ct) 
/or any x £ X and any stopping times t,o~. In particular, 

(2.21) V(x) = J x (f,<7), VxgX. 
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Proof. We sketch the proof given in [B] which used the result in [T7]. The case 
where H = is due to Theorem 12. II For a nonzero H satisfying (|2.4[) . (12.151) admits 
a finite finely continuous solution 

V = inf sup J° (r, o-) = sup inf j£ (r, ct) , Vx 6 X, 

r cr cr T 

and 



where h\ = —fx + R a H, hi = fi — R a H are finite finely continuous functions. 
Applying Dynkin formula to e~ Qt P Q P(X t ) yields 



(/■tAct 
y Ce- at R a H{X t )dt 

J (-ae- at R a H{X t ) + e~ a< XR a H{X t )) 

= R a H(x.) - E x (J 



dt 



e- at H(X t )dtj , 

where C is the infinitesimal generator, and this leads to 

J x (t,ct) = J°(r,a)+R a H( X ). 

Now it can be seen that the variational inequality problem (|2.3p and (|2.4I) admits a 
finite finely continuous solution 

V(x) = V°(x) + R a H{-x), x G X. 



3. The Dynkin Game and Its Value Function. Two players Pi and P2 
observe a multi-dimensional underlying process X t in (jl.ip with accumulated income, 
discounted at present time, equalling J Q e~ at H(X t )dt for any stopping time cr. If 
Pi stops the game at time a, he pays Pi the amount of the accumulated income 
plus the amount fi(X a ), which after been discounted equals e~ aa fi(X a ). If the 
process is stopped by Pi at time a, he receives from Pi the accumulated income 
less the amount /i(X CT ), which after been discounted equals e~ a(T fi(X a ). Pi tries to 
minimize his payment while Pi tries to maximize his income. The value of this game 
is thus given by 

(3.1) V(x) = inf sup JJt,o), Vxel", 

T a 

where J x is given by (|2.17p on R". 

Assumption 3.1. H(x) = H(xi,...,x n ) is a continuous function on R™ such 

that 



P(x,0)=0, Vxe 



in- 1 
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and for any x G R", -ff(x) is strictly increasing in x n . Furthermore, -ff(x) satisfies a 
uniform Lipschitz condition on x n : there exist L 1; L 2 > such that 

Li\x„i - x n2 \ \H(xi,...,x n -i,x nl ) - H(x 1 ,...,x n ^ 1 ,x n 2)\ s$ L 2 \x n i - x n2 \. 

Define ^4(x), B(x) to be smooth and uniformly Lipschitz functions on R™ _1 such 
that -Ci < A(5t) < C 2 < < C 2 < S(x) < d, Vie R"" 1 for constants Ci, C 2 > 0. 
The determination of A(x),_B(x) will be given shortly. Define the region 

D = (-oo, oo) x ■ ■ • x (-oo, oo) x (A, B) = R" -1 x (A, B), x G R"~\ 

which is a subset of R™. It can be seen that £f(x) is uniformly bounded in B, so is 
R a H(x), x G B. 

Assumption 3.2. /i(x), / 2 (x) > 0(Vx G R") are bounded and smooth functions 
such that -M < -/i(x) < — /3 < < /3 < f 2 (x) < M, Vx G R™ for fixed constants 
M, f3 > 0, and further 



f^(x) > 0, |^-(x) < 0, Vx G B, 

OXji OXn 

/i(x, 0) = ci, / 2 (x, 0) = c 2 , Vx G R™ _1 where ci > 0,c 2 > are constants. 
£/i(x, x„) is strictly decreasing in x n for fixed x, Vx G R n_1 x (A(x),0), 
£/ 2 (x,x„) is strictly increasing in x n for fixedx, Vx G R n_1 x (0,i?(x)). 

Remark 3.1. Notice that (3/2 andO are two a- excessive functions, and— /i(x) < 
0/2 - < / 2 (x). If we define H+(x) = max(iJ(x), 0), ff"(x) = min(ff(x), 0), tfien 
G Q -ff + (x) and —G a H~(x.) are a-excessive functions. Put «i(x) = j3/2 — G a H~(x.) 
and v 2 (x.) = G a H + (x), then the separability condition 12. 1 6\) holds for —f\ and f 2 . 

Consider again the diffusion Define its infinitesimal generator C as 

n Pl n £)2 

(3.2) v * 



where [Aij] = A(x) = \aa T . Notice that since ct^ 's are functions of Xu, ...,X(n-i)t, 
so is A. For x G R™ _1 , we assume A(x) is positive definite and there exist two 
constants ei,e 2 such that < t\ < det(A(x)) < e 2 < oo for any x G R™ -1 . It 
can be seen that C is uniformly elliptic. Define the measure m(dx) = e bx dx, where 
b = A _1 /x, then it is obvious that m is a positive Radon measure. For the generator 
C, its associated Dirichlet form (£, J^") densely embedded in L 2 (B;m) is then given 

by 

(3.3) £(u,v)= / Vu(x) • AVv(x)m(dx), u,uG#", 

where 

& = {u e i 2 (B) : u is absolutely continuous, / Vw(x) T VM(x)m((ix) < oo}. 

Jo 

Because f\ , f 2 are continuous and the underlying process possesses continuous sample 
paths, obviously fi, f 2 are also finely continuous functions. 
Assumption 3.3. For any stopping time a we have 

A(x) < E x (e-" CT /i(X CT )) + 4M(1 - E x (e^)), 
/ 2 (x) < E x (e- QCT / 2 (X CT )) + 4M(1 - E x ( e - QCT )), 
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where M was given in Assumption^ 

Assumption 3.4. There exist smooth and uniformly Lipschitz continuous junc- 
tions a(x),b(x), x G R™ _1 , such that, 

(a-£)/ 1 (x,a(x))+ J ff(x,a(x)) = 0, 
(a-£)/ 2 (x,6(x))-H(x,6(x)) = 0, 
and A(x) < <z(x) < < 6(x) < S(x), Vx G R n_1 . 



Remark 3.2. Because a(x),6(x) are uniformly Lipschitz and X t is uniformly 
elliptic, each boundary point of the region R™ -1 x (a, 6) is a regular boundary point 
for the process X t . In fact, the uniform interior cone condition is satisfied, e.g., see 
Section 2 in f!61j . 

We are now concerned with a solution V G JF, V ^ — fi of 

(3.4) £ a (V,u-V)>(H,u-V), Vue#, u > -fx, 

and by a similar proof of Proposition 12.21 and the fact that G a H(K) is continuous by 
the dominated convergence theorem, it can be shown that there exists a unique finite 
and continuous solution V to (13.41) . Again by the dominated convergence theorem 
and the absolute continuity of the transition probability function p t , it can be easily 
shown that the point wise limit of V, given by 

(3.5) VYx) = limp 4 y(x), x G P, 

t— >o 

is finite and continuous. What is more, V is the solution to the optimal stopping 
problem with holding cost H , which is a slight extension of Theorem 1 in [7 . In what 
follows we may still use V to denote V since V = V m-a.e. 

With the newly defined (£ a , j?) , the conditions on H and /i , /2 , and together 
with the holding of the separability condition, we can, by a similar proof to Theorem 
2 in [TJ, extend Theorem 12.31 as follows : 

Theorem 3.1. For the functions H satisfying Assumption \3.l\ and f\,fi G ^ 
satisfying Assumvtion \3.2l we put 

/ rrf\<J 

(3.6) J x (t,ct) = £ x U e- at H{X t )dt 

(3.7) +£ x (V Q ^ (-/ CT<T /i(X CT ) + J T<(T / 2 (X T ))) 

/or any stopping times t,o~. Then the solution of \2. 3\) and \2.1$ admits a finite and 
continuous value function of the game 

(3.8) 7(x) = inf sup J x (r,cr) = sup inf J x (r, cr), Vx G R™. 

Furthermore if we let 

E x = {x G K" : K(x) - -/i(x)}, E 2 = {x G R" : V(x) = / 2 (x)}, 
i/ien the hitting times f = te 2 > & — te 1 is the saddle point of the game 



(3.9) 



^x(r,cr) < J x (f, <t) < J x (t,(t) 
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for any x G R™ and any stopping times t,o~. In particular, 
(3.10) V(x) = J x (f, a), Vx £ M". 

In the rest of this section we will characterize the optimal control policies and 
regularities of the value function V(x), whose existence has been shown. 

3.1. Optimal Switching Regimes. 

Proposition 3.2. For any (x, x n ) with x n < a(x), 

(a-£)/i(x,a(x)) + JT(x,a(x))<0, 
and for any (x, x n ) with x n > a(x), 

(a-£)/i(x,o(x)) + fl-(x,a(x))>0. 
Similarly, for any (x, x n ) with x n < b(5c), 

(a-£)/ 2 (x,6(x))-H(x,6(x)) > 0, 
and for any (x, x n ) with x n > o(x), 

(q-£)/ 2 (x,6(x))-H(x,6(x)) <0. 



From the conditions on H in Assumption 13.11 and the conditions on f\ and fi in 
Assumption 13.21 this result can be easily seen. 

The two boundary curves A(x), -B(x) are chosen according to the following lemma. 

Lemma 3.3. There exist A(x) < < S(x), Vx G R™ -1 such that the diffusion 
M = (X t ,P x ) on B satisfies 



to At A 

at \ 



(3.11) E Sl [ I e- at H(X t )dt ) < -2M, 

i-tqAtb 



(3.12) % (J e~ at H(X t )dtj > 2M, 

for some £i G R" -1 x (A(x), 0), and £ 2 £ R" -1 x (0, B(x)), M being given in Assump- 
tion VS.'A and t$,ta,tb denote the hitting times to the graphs of x n = 0, A(x), B(x) 
respectively. 

Proof. Let ii° be the resolvent operator of an absorbing diffusion D on the 
region D C R™, whose dynamic equation in the interior of D is given by (jl.ip . Let 
c = c(x), x G R n_1 be any bounded continuous function. Since D is conservative, 
the hitting probability E x (e~ aTc ) (a > 0) tends to zero as x n — > ±oo. From 

_1 x ( — oo.c) 



(x, Xn), 











J" 


e~ at ( 


JO 




1 


1 


a 


— e 

a 



we have 

(3.13) lim Rf~ lx (-°°> c h(x,x n ) = -. 



x n —> — oo 
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By Assumption 13.11 we can choose Z(x) < 0(x £ R™ x ) uniformly bounded, and 

H(x) < -4aM, Vx e M n_1 x (-00, 1). 
Then by p,13[) . for each Xo £ K™ -1 there exists ??i(xo) < i(xo) such that 

Because the generator of the underlying process is uniformly elliptic, the function 
771 (x) can be chosen uniformly bounded. 

Choose a smooth and uniformly bounded function A(x) such that A(x) < r/i (x) , Vx 6 
M n_1 , then again due to the uniform ellipticity of the generator, A(x) can be chosen 
so that 

iJ*"" lx ^l(x I% (x)) > Vx 6 R™" 1 . 

2a 

Now the process obtained from M by killing at tq A ta coincides with D on 
M n_1 x (A, 0) and we may just pick £1 = (x, ?7i(x)) and have 

E (l QP^ e- at H(X t )dt^j = ig-^WHfa) 

< -4aMEf _lx ^)l(a) 

< -2M. 

The second inequality of this Lemma can be proved in a similar way. □ 
In the above proof, we could also choose A(5c) so that 

(3.14) B x (e- aT «) < i, Vx - (x,z n ) e R" and z„ < A(pt). 

A similar assumption is made on the curve -B(x). 

Consider the solution V(x) of the variational inequality problem (12.31) and (12 .4[) 
for the Dirichlet from (£, (J3T3J) on ED, which is also the value function of the Dynkin 
game by Theorem 13. II 

Proposition 3.4. It is not optimal for Pi to stop the game when X t < (or 
equivalently i7(X t ) < 0), and it is not optimal for Pi to stop the game when X t > 
(or equivalently iJ(Xt) > 0). 

Proof. Recall that P\ tries to minimize his payment. If H(X. t ) < 0, the accumu- 
lated amount keeps decreasing, and it would be better for Pi to stop the game when 
X t > (or equivalently H(K t ) > 0) because the penalty /2(X t ) would be smaller in 
this case. A similar argument can be made for Pi. □ 

Proposition 3.5. For any starting point Xo = (xo,ir n ) G M. n of the game, if 
x n A(xo), it is optimal for P2 to stop the game immediately; and if x n B(xq), it 
is optimal for Pi to stop the game immediately. 

Proof. We only need to show the first half and the second half can be done in 
a similar way. If P2 stops the game immediately when x n ^ A(xq), he receives the 
quantity — /i(xo) from Pi (indeed he pays money to Pi). Assume the game is not 
stopped immediately but is stopped at a stopping time a. If a ^ T r/1 , this means 
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Pi stops it before the process reaches the curve 771 which was given in the proof of 
Lemma 13.31 then the amount P 2 receives is given by 

(J e-"H(X,)dtJ - £*„ (e-"'/,(X„)) 
a 

= -4M(1 - P X0 (e- QCT )) - £ Xo (e-^AfX,)) 
^ — /i(xq) by Assumption 13.31 



Suppose a > r r]1 , then the amount P 2 receives is at most 

E X0 ( p 1 e- at H(X t )dt) +E X0 (e- a ^V(X T J) 







where V(-) is the solution of the variational inequality problem ()2.3[) and (|2.4|) . hence 
|V(x)| M, Vx G 1". 
Therefore we get 

£ X0 ^ T " 1 e - Qt ff(X t )di) +£ X0 (e- ar "^(X T , i )) 

< -4Af(l-£; xn (e- Qff ))+M 

< -AM ( 1 - - ) +M by the choice of A and 771 



2 / 

= —M < — /i(xo) since /1 is bounded by M. 

From both cases, we can conclude that it is optimal for P 2 to stop the process im- 
mediately if x n ^ j4(xo). Similarly we can show that it is optimal for Pi to stop the 
process immediately if the starting point is x = (x Q , x n ) € R™ with x n -B(x ). □ 
Corollary 3.6. Let (t, <r) be the saddle point in i3.9\) . then f,a are finite a.s. 
Proof. Because the two curves -A(x), -B(x) are uniformly bounded, and the gener- 
ator of the underlying process is uniformly elliptic, if we let ta, tb be the first hitting 
time of the last component X n to the two curves A(5c), -B(x), assuming that the game 
starts at a point inside R™ -1 x (A, B), then we can conclude that ta At^ is finite a.s., 
and the result simply follows due to the fact that f A a ^ ta A tb a.s. and beyond 
the region B the game is stopped immediately. □ 
Proposition 3.7. 
1. -A(x,0) < f (x,0) < / 2 (x,0), Vx g R n_1 . 

Proof. Let <5(x) > be a continuous function such that — /i(x, 0) < -ff (x, — 5(x)) < 
0, -5(x) > A(x), Vx G R"" 1 , sup x |<J(x)| = b s < 00, and bs -> as S ->• 0. 
Let Ta fee £/ie hitting time of the process to the curve <5(x), i/ien from i3. 9\) 
and for all x G R ra_1 , i/ie following holds: 

7(x,0) 

^ ^(x,0)(^' 



%,0) ^ T " e- Qt i/(X t )^j 
-%,0) (e- QT -Vi(X r _J|r_ 5 < f) P(r_ 5 < f) 
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e~ 



at dt 



+%,0) (e- Qf / 2 (X f )|r_ 5 > f) P(t_ 5 > f) 

> -l 2 6 5 ^(x,o) ^ y 

-%,0) (e- QT -Vi(X T _J|r_ 5 < f) P(t_ s < f) 
+/3%,o) (e~ Qf |r_ 4 > f) P(r_ 5 > f) 

= (1 - %,0) (e- QT - |r_ 5 < f )) P(r_ 5 < f ) 

(1 - E (m (e- af |r_ 5 > f)) P(r_ 5 > f) 
-%,0) (e- ttT -Vi(X T _J|r_ d - < f) P(r_ 5 < f) 
+0%,o) (e- Qf |r_ A - >f) P(t_,>t) 
= -/i(x,0) 

+% >0) f/i(x,Q) -e- Qr -Vi(X T _J - ^(l-e-^)|r_ 5 < P(r_ 5 < f) 
+%,0) f/i(x,0) + /3e~ Qf - ^(1 - e- ttf )|r_ 5 > f) P(r_ 5 > f) 



f%,0)(/i(x.Oi -<-' T -f l{ X r — (1 -)|r „•'. r ) Pi r_, r) 



> -/i(x,0) 

+^(x,0) ^. 

> -/i(x,0) 

+%,0) (ci(l - e-™-' ) - ^(1 - e - QT -)|r_, < A P(r_ 5 < f) 
= -/i(x,0) + E [m (( Cl - ^i) (1 - e-^-OIr-, < f) P(r_ 5 < f) 



a 

> — /i(x,0) for sufficiently small 65. 

The second inequality can be proved in a similar way. □ 
2. K(x) > -A(x) for x € M"- 1 x (0, B) and ^(x) < / 2 (x) /or x 6 M"" 1 x 
(AO). 

Proof. We may just give proof to the first inequality and the second one can 
be proved analogously. Notice that for x € K™ -1 x (0, B), 

V(x)> Jx(r,r ) 



P* 



/•tAto \ 

y e- at H(X t )dt\ - P x ( e - QT0 /i(X ro )|r < f) P(r < f) 



+P X (e~ Qf /2(X f )|r > f) P(r > f) 
>- Cl Px(e- Qr °|r <f) P(r <f) 

> -ci 

> — /i(x) by Assumption 13.21 



□ 

Define the set 

(3.15) P = {x e R" : -/i(x) < 7(x) < / 2 (x)}, 
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then obviously (x,0) S E, Vice R™ _1 . Since P 2 would stop the game once V(x) ^ 
— /i(x) and the instant payoff is — /i(x), while Pi would stop the game once V(x) ^ 
/2(x) and the instant payoff is /2(x), we could write R n as a partition: 

1" = Ex UEUE 2 , 

where E 1 , E 2 were given in Theorem 13.11 
Proposition 3.8. For each x e E\, 

(a-r)/i(x) + H(x)<0, 

and for each x G E 2 , 

(a-£)/ 2 (x)-ff(x) <0. 



Proof. We only give proof to the first half. We know at the point x £ £i it must 
be true that V(x) ^ — /i(x), and it is optimal for P 2 to stop the game immediately. 
Suppose 

(a-£)/i(x)+#(x) >0, 

then by the smoothness of /x, the continuity of _ff and the Lipschitz condition on a(-) 
and &(•), we can find a small ball B r (pc) containing the point x, such that for each 

y e s r (x), 

(a-£)/i(y)+ff(y) >0. 

Consider a policy for P2 to stop the game at the first exit time of B r (x), denoted tb t - 
Then by Dynkin's formula, the payoff would be 

Jx = E x f B " e- at H(X t )dt + E x (e~ aTB -(-fi(X) TBr )) 
Jo 

= Px f B " e- at H(X t )dt - / x (x) + E X f ^ e' at (a - C)fi(X t )dt 
Jo Jo 

= -A(x) + E X f ^ e- at [(a - £)/i(X t ) + H(X t )]dt 
Jo 

> -/i(x). 

This is a contradiction since P 2 tries to maximize his payoff but we assumed the 
optimal policy at x was to stop the game immediately. □ 

Corollary 3.9. 7/x = (x, x n ) € E%, then for any point (x,y) with y < x n , 

{a-£)fi(x,y) + H(it,y) < 0. 

7/x = (x, x n ) S £?2; then for any point (5c, y) with y > x n , 

(a-C)f 2 (5c,y)-H(5c,y)<0. 

This can be easily seen from Proposition 13.81 and the properties of fi , f 2 given in 
Assumption 13.21 

Proposition 3.10. If 

(a - £)/i(x, x n ) + H(5c, x n ) < 0, Vx e M n_1 , 
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then it is optimal for P 2 to stop the game immediately. If 

(a - £)/ 2 (x, x n ) - F(x, x n ) > 0, Vx e E" _1 , 

then it is optimal for P\ to stop the game immediately. 

Proof. Again we give the proof of the first half. Suppose 

{a - L)h(x,x n ) + H(9L,x n ) < 0, Vx g E n_1 , 

then x n < a(x) where a(x) is given in Assumption 13.41 If P2 stops the game imme- 
diately, the payoff is — /i(x),x = (x, x n ). Suppose it is optimal for P 2 to stop the 
game at a stopping time a > a.s. We compare a with the hitting times ta and r a . 
Suppose a ^ r a , by Dynkin's formula, the payoff for P2 is 

E x Qf e- at H(X t )dt - e- aa fi(X a )\a < r a ) P x (a < r„) 

= f-/l(x) + P x Q£ e~ Qt (H(Xt) + (a - £)/i(X t )) dt|<r ^ r Q ^ P x (a < r a ) 
<-/i(x)P x (<7<r a ), 
because 

fT(y) + (a-£)/ 1 (y)<0, VyGR'- 1 x (-00, a). 

Since P2 tries to maximize his payoff, the result (|3 . 1 6[) tells that along the paths 
of X f , P 2 should not stop the process before these paths touch the curve (x, a(x)). 
However, consider the paths such that ta < T a . Because a(x) is smooth and uniformly 
Lipschitz, i.e., it satisfies the interior cone condition, and the underlying process is 
uniformly elliptic, we have P(ta < T a ) > 0. But we have shown that the optimal 
policy for P 2 at the curve (x, A(5t)) is to stop the game immediately, and this gives a 
contradiction. 
□ 

By Proposition ^. 81 and Proposition ^. 10| we can tell 

R n_1 x (-cx),a)C Ei, 
W 1 - 1 x (&,co)C E 2 . 

Further, from the proof of Proposition 13.81 we can see that, since 

(a - £)/i(x) + P(x) > 0, Vx g R" -1 x (a, 6), 

which implies V(x) > — /i(x), it is not optimal for P 2 to stop the game in this region, 
and also because 

{a - £)/ 2 (x) - H (x) < 0, Vx g R"- 1 x (a, b), 

which implies V(x) < /2(x), it is not optimal for Pi to stop the game in this region. 
Therefore we can tell 

R n_1 x (a,b) C E. 
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By Theorem 13. 1[ the optimal policy for P 2 is to stop the game at the first hitting 
time of Ei, while the optimal policy for Pi is to stop the game at the first hitting 
time of E2, and because the boundary points of R™ -1 x (a, 6) are all regular boundary 
points, we can conclude that: 

Corollary 3.11. 

R™" 1 x (-00, a] = Ei, 
R"" 1 x [6,00) = E 2 , 
W 1 - 1 x (a, b) = E. 



3.2. Regularities of the Value Function. 

PROPOSITION 3.12. V is smooth on R' 1-1 x (a,b), and 

(3.16) aV(x) - CV(x) = ff(x), x g R™ -1 x (a, b), 

(3.17) aV(x) - £V(x) > H(x), x g R" -1 x (A, a), 

(3.18) aV(x) - CV(x) < if (x), x e R n_1 x {b, B). 

Proof. We notice that V is H-a harmonic on l"" 1 x (a, b), which by [5] implies 
the validation of the following equation: 

(3.19) £ a (V,u) = (H,u), Vu g ^'•••' 1 (M™- 1 x (a,b)). 

The continuity of H implies that V is smooth on the same region, and an integration 
by parts yields (|3.16l) on this region. The rest of the proof follows from the fact that 
V(x) = -A(x),Vx g K™" 1 x [A, a] and V(x) = / 2 (x),Vx g [b,B]. □ 

Now we may extend V to R" by letting V(x) = -/i(x), Vx g R" -1 x (-00, a], 
and V(x) = / 2 (x), Vx g R" -1 x [b, 00). 

In what follows we will characterize the properties of V at the boundary curves. 

For any point (xo, a(xo)) on the curve a, let 5(xo) be a small positive number, and 
denote Si (x) , <5 2 (x) two continuous curves such that oi(xo) = <5 2 (xo) = S(xq) > 0, and 
they are chosen in the following way: since X t is conservative, we can choose a region 
Bx C R n_1 containing Xo so that the probability that X t leaves B^ a x (a — 61,0 + 82) 
without hitting a — Si or a+<5 2 is of the order o(i5(xo)). Because (xo, a(xo)) is a regular 
boundary point which satisfies the inner cone condition, we could choose 5±, <5 2 so that 

-P(xo,a(xo))( r a-<5l < T a+ S 2 A T a fi) = P(x ,a(x )) ( T a+<5 2 < T a-<5i AV G ) = \ - o(5(x )), 

where T a Sii T a +s 2 are the hitting times to the curves a — Si and a + <5 2 , respectively, 
and r a fi is the exit time of the connected region G C B^ x (a — Si , a + <5 2 ) containing 
(xo,a(xo)) but without hitting a — Si or a + <5 2 . Notice that P(r a fi < r a -& 1 Ar a+ s 2 ) = 
o(<5(xo)). Let T a ,s be the exit time of the region G, then T a ,s — t a.G A r a -s 1 A r a +s 2 
a.s. Furthermore, since V is smooth a.e., on the region B^ we can make Si and S2 
satisfy that 

E(x , a fr ))[e- aTa - s iV(X TaS )\T a - Sl < r a ,G A T a+ s 2 ] = V(xq, (a - S)(5c )) + o(S(x )), 
and 



#(x ,a(x ))[e aT ^V(X Ta S )\T a+ s 2 < T a . G A T a _ 5 J = V{x , (a + 5) (x )) + o(<5(x )). 
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By Assumption 11.11 and the fact that X t is uniformly elliptic, we have 

% ,o( X0 ))( T a,<5) = o(S(xo)), 
(see, e.g., [B], [H]). Further, we notice that 

l-£(x ,a(x )) (e~ QT ^) = aEfxo.aCxo)) e" Q *d/) < a£ (x0:a(xo)) (T a!(5 ) = o(<5(x )). 

Proposition 3.13. 

Proof. We only prove the first equality, and the second one can be proved analo- 
gously. Pick any xo G R™ _1 and Ze£ <5(xo), <5i, #2 6e chosen as discussed a priori, and 
we borrow the notations T a fij T a ^s 1 , T a+ a 2 , r a)< 5 therein. Since f = r a j + f o # Ta ( where 
6t is the shift operator, we get 

t A a = r a ,s + (f A a) o 9 TaS , 

where a = r a fi + a o # Ta 5 . Therefore by \3. 9\) 

F(xo,a(x )) > J(x ,a(x ))(' ? ' ; cr ) 

- % 0) a(x o) ) QT*' e~ at H(X t )dt 

+ -E'(x ,a(xo 

+-E(x ,a(x )) (e" aTa+s 2y(X Ta s)\ T a+S 2 < T a-<5i A T a , G ) P(5c ,a(9. ))( T a+8 2 < T~a—5i A 7"a,G^ 
+ #(x ,a(x )) (e~ QTa ' G y(X ra (5 )|T Q: G < T Q _ 5l Ar a+ 5 2 ) P(x ,a(S a ))( T o,G < T a-5i AT a+< 5 2 ), 

(3.20) 

due to £/ie /act i/ia£ ^(x, a(x)±<5(x)) = J( x ,a(x)±c5(x)) (^j <?")• <5*nce y is bounded, \3.20\) 
further yields 

(V(xo,a(xo) + <5(x )) - V(xo,a(x )))P(x 0: Q(xo))( T a+<52 < T a -Si Ave) 
«S (V(xo, a(x )) - V(xo, a(x ) - <5(x ))) P(x , a (x )) ( T a-«i < T a+ s 2 A r ajG ) 

-%o,a(x )) (£°' S e- at H(X t )dt\ +o(S(x )). 

By Assumption \3.1\ it is obvious that H is bounded on R"^ 1 x [A, 0], i.e., there 
exists U > such that |F(x)| < U, Vx e K"" 1 x [A,0]. Then we have 

(3.21) (V(xo,o(xo) + <5(x )) - y(xo,a(x )))P(x 0:Q (x ))(T Q+ 5 2 < T a - Sl At„ iG ) 

«S (V(5co,o(xo)) - y(x ,a(x ) - <5(x )))P(x , Q (x ))(T"a-5i < t„ + j 2 A T a , G ) 



-t^(x ,a(xo)) (J "' e~ at dt^j +o(6(5t )) 



(V r (x ,a(x )) - V r (x ,a(x ) - 5(x ))) P(x ,a(x ))( T a-5i < t q+<5 2 At QiG ) 
+ - (1 - % ,a(xo)) (e^' 3 )) + °(*(*o))- 
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Divide both sides of \3.21}) by <5(x ) and let <5(x ) — > 0, we get 

V(x 0l a(5c ) + <5(x )) - V(x ,a(x )) 

llm 7F=—\ 

<5(x )->0+ d(x ) 

< j. y(x Q ,a(x )) - y(x ,a(x ) - <5(x )) 
^ <5(x )-^o+ S(x ) 

/i(x ,a(x )) - /i(x ,a(x ) - <5(x )) 

= - llm 77=~\ • 

<5(x )^0+ d(x j 

On the other hand, since 
-/i(xo,a(x ) + S(xo)) - (-/i(x ,a(x ))) < ^(x ,a(x ) + <5(x )) - V(xo,o(xq), 
which means 

/i(x ,a(x ) + 5(xo)) - /i(x ,a(x )) 
- lim — — 

<5(x )^0+ 0(X ) 

y(x ,a(x ) + 5(xo)) - V(xo,o(xo)) 

«S lim rr— , 

<5(x )-+0+ d(x ) 

it can be concluded that 

9V , , dfi , ,_ .. 

- — (x ,a(x )) = -- — (x ,a(x )) 

C t/j t/ ti< 7^ 

&?/ the differentiability of —fx- U 

Let dV u denote the directional derivative along a vector u6i™. Ifu^(u, <9a Q (x)) 
(or u ^ (u, 96 Q (x))), by repeating the above proof we can show that dV u (5c,a(x)) = 
— <9/iu(x, a(x), <9V u (x, &(x)) = 9/ 2u (x, 6(x)), Vx e R™ -1 . If u is in the direction of 
(u,9a a (x)) (or (u, c?6q(x))), we have 

flV B (x,«(i)) = lim nx + Au, a (x + Au))-nx, a (x)) 

-/i(x + Au,a(x + Au)) - (-/i(x,a(x))) 

= lim 

a^o A 

= -9/i u (x,a(x)), 

and by a similar proof, <9Vu(x, b(5c)) = d/2u(x, 6(x)), Vx € R n_1 . 

Since V satisfies (|3.16[) . where H is continuous and C is uniformly elliptic, and 
V = -fx on M™- 1 x (-oo, a] ( V = f 2 on R" _1 x [b,oo)), it can be seen that 
limA->.o 9 u V((x, a(x)) + Au) exists for any directional vector u (similar result is ob- 
tained on the curve of b). Therefore, d u V is continuous everywhere. 

As a summary we have the following theorem: 

Theorem 3.14. There exist unique smooth and uniformly Lipschitz functions 
a(x),6(x) such that A(x) < a(x) < < 6(x) < -B(x) and 

-/x(x) < V{x) < / 2 (x), Vx G K"- 1 x (a, 6), 



V(x) = -A(x), Vx G R"" 1 x (-00,0], 
7(x) = / 2 (x), VxeK"- 1 x [6,00), 
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0V u (x,a(x)) = -0/ lu (x,a(x), c^ u (x, 6(x)) = 3/ 2u (x, 6(x)), Vx G 



in- 1 



where u is any directional vector. 

Furthermore V is C 1 ' "' 1 ' 1 on R n , C 2 '"' 2 on R n_1 x (a, 6) UR"" 1 x (-oo,a) U 
W 1 - 1 x (b,oo) and 

a7(x) - CV(x) = H(x), Vx G R" -1 x (a, 6), 
aV(x) - £V(x) > if (x), Vx G R" -1 x (-oo, a), 
aV(x) - £y(x) < ff(x), Vx G R™ -1 x (6, oo), 

where C is given in LS.2\) . 

4. The Multi-Dimensional Stochastic Singular Control Problem. Define 
/i(x), W(x), x e R", as follows: 

(4.1) h(x,y)= [ V H(x,u)du + C(x), 



rv 

(4.2) W(x,y)= V{±,u)du, x e R n ~\ y G R, 

where C(x) is a function of x such that 

lim aW(x,y)-£W(5c,y)-h(x.,y) = 0, 

then h(x.,y) and W(x, y) satisfy the following: 

Theorem 4.1. W is C 2 '"' 2 on R™ and £/iere exist unique, smooth and uniformly 
Lip schitz functions a(x),6(x) smc/i i/iai A(x) < a(x) < < 6(x) < B(x) and 

aW(x) - £W(x) = fc(x), Vx G R™ -1 x (a, 6), 

aW(x) - £W(x) < ft(x), Vx G R"" 1 x (-oo, a) U R"' 1 x (6, oo), 

-/i(x) < /-W(x) < / 2 (x), Vx G R"- 1 x (a, b), 

UXn 

^-W(x) = VxGR"- 1 x (-oo,a], 
^-W(x) = / 2 (x), Vx G R"- 1 x [6, oo), 



-W(x,a(x)) = -|^(x,a(x)), 



dxndxk ' dzfc 

-A_^(x,6(x)) = |^(x,6(x)), Vx G R"- 1 , 1 < k < n. 
axndxk axk 

We first need a lemma. 

Lemma 4.2. TTie function aW{x) — £W(x) is continuous. 

Proof. This result obviously holds for x G R"" 1 x (-oo, a) UR™" 1 x (a, b) UR"" 1 x 
(6, oo). On the curves a(x) and 6(x), W is twice continuously diffcrentiable along the 
x n direction by (I4.2p . The only term that seems not to be continuous in this function 
is CW(x), which involves the first and second derivative with respect to each variable. 
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Denote d Xk W the directional derivative along x kl l ^ k ^ n — 1, then by (|4.2|) we 
have the following: 

d Xk W(x, y) = ( d Xk V(x,u)du-V(x,a(x))d Xh a(x). 

Ja(S) 

Notice that V is C' 1,1 ' "' 1 on W 1 , so d Xk W(x,y) — d Xk W(x) is continuous in x. Now 
consider 

d 2 W _ f y d 2 V 

■^-r( x >y)= / 7 r^-(x,u)du~2d Xk V(x,a{x)) ■ d Xk a{x) 

ox k Ja(x) ox k 

~d Xn V(x,a(x)) ■ (d Xk a(x) f - V(x,a(x))0(x). 

Because the two curves a(x) and &(x) have zero Lebesgue measure, and the functions 
d Xk V, d Xk a and ^f- are all continuous, we conclude that is continuous, 1 ^ k ^ 

n — 1. The continuity of gd ^ , i 7^ j, can be proved in a similar manner. Combined 

with previous argument that ^jjf- is continuous, this lemma is proved. □ 

Remark 4.1. Since (a — Z^VF is continuous, and the functions V and H are 

continuous too, we know that the function h(x) in \4-l\ ) is continuous, hence the 

continuity of C(x) in 

Proof. [Proof of Theorem 14. 1| For fixed x, consider the function 

U(y) = aW(x, y) - CW(x, y) - h{x, y) 

with 

U'{y) = aV(x, y) - CV(x, y) - H(x, y), 

and we know U(a(x)) = 0. Notice that U'(y) = for a(x) < y < b(x); U'(y) > for 
y < a(x); U'(y) < for y > b(x), and by Lemma l4~2l the function U{y) is continuous, 
it can be seen that 

aW(x, y) — £W(x, y) < h(x, y), for y < a(x) or y > b(x). 

The rest of the proof is obvious. □ 

The result of Theorem 14.11 gives conditions to the solution of the stochastic sin- 
gular control problem ()1.3[) and (|1.5p (see, e.g., [15]). where the holding cost h(-) is 
given in (|4. 1[) and the boundary penalty costs /2G) are given in Assumption 13. II 

We call a quadruplet S = (S, X t , , A ( ? ] ) (S = (A^^A^) for simplicity) 
admissible policy if the following conditions are satisfied: 

Assumption 4.1. 

[1] S is a compact region given in the form R™ -1 x [j3,j] where /3(x),7(x) are 

continuous functions of x G R™" 1 with /3(x) < 7(x). 
[2] There is a filtered measurable space (f2, {^t}t>o) subject to usual conditions 

and a probability measure {-P x }xes on it such that 
{X t } t ^o is an \Tt\-adapted process, and 

{^4.^, A\ }t^o are {J~t}- adapted right continuous processes with bounded 
variation such that 



(4.3)E X / e- at dAY> < oo,^ x / e-^dAf' < 00, Vx e S, 
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and — A^ is the minimal decomposition of a bounded variation 
process into a difference of two increasing processes. 
[3] There are {J- t }-adapted independent Brownian motions B\ t , B mt (m ^ n) 

starting at the origin under P x for any xgS such that the following controlled 

diffusion X t = {X u , ...,X nt ) 

(4.4) dX u = fiidt + crudBit H h a lm dB mt , 



dX nt = n n dt + UnidBxt H h a nm dB mt + dA^ - dA[ 2 \ 

X = x, 

holds P x -a.s., Vx G S. Furthermore we assume 

P x (X t eS,W >0) = 1, VxeS*. 

Remark 4.2. TTie probability space with the filtration {J 7 *} «s not fixed a priori. 
It is part of an admissible policy. The filtration { J 7 *} is assumed to be right continuous 
and J-o is assumed to contain every P x -negligible set for any x G S . 

PROPOSITION 4.3. Both A^ and A[ 2 ^ are nontrivial in the sense that for any 
T > 0, 

P x (A { t l) = A { Q l \ V*e[0,T]) = 0, VxgS, i = 1,2. 

Proof. If both A^ and A\ are trivial, X t will hit every open region of positive 
Lebesgue measure in R" with positive probability, but this is a contradiction since X f 
is concentrated on S. If either Aj or A^ 2 '' is trivial, X f can not be concentrated on 
S which again is a contradiction. □ 

Define the following notations: 

AA?> =A?> -A®, t> 0,4 = 1, 2, 
AX t = X t -X t _, t^O, 
AW(X t ) =W(X t ) - W(X t -), i^sO. 

Then due to the fact that A^ 1 ', a! 2 -* are the minimal decomposition of a bounded 
variation process into a difference of two increasing processes, AA( 1 ' ) • AA[ 2 ^ = 0, Vi ^ 
0. By convention we let 

B lt = ■ ■ ■ = B nt = 0, A ( P = A {2) = 0, Vt < 0, 

so that 

AA { l) = Af, i = 1, 2, X = x P x a.s., xgS. 

Notice that the integrals in (|4.3p involve the possible jumps at time so that they 
are the sum of the integrals over (0,oo) as well as Aq,i — 1,2. What is more, the 
jump only happens to the x n coordinate. In what follows, we use A^'°{i = 1, 2) to 
denote the continuous part of the processes Af\ i = 1,2. 

Theorem 4.4. Let h(x), W(x) satisfy the conditions of Theorem \4-l\ and fcs(x) 
be given by the following 



(4.5) 



k s {x)=E x ^J e~ at h(X t )dt 
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( ^ / /■*»*- +A ^ 15 

+£ x £ e ~ at / h(X*)dv 



i 0^t<oo 



/ 2 (X t )dy 



where satisfy Assumvtions uTzl \3.3\ and \3.4\ then 

1. For any admissible policy S, W(x.) ^ fes(x), Vx G R n . 

2. W(x) = fc s (x), Vx e l n , i/ and only if S = R™" 1 X [a, 6], w/iere a(x), 6(x) are 
given in Theorem \4- 1\ the process X t is the reflecting diffusion on S , and S = 
(A^\ A[ 2 ^) where A^ increases only when X f is on the boundary (x, a(x)) 
and A[ 2 ^ increases only when X t is on the boundary (x, 6(x)), Vx S R" _1 . 

Remark 4.3. The cost function consists of several parts. The first integral in 
is the holding cost. The second integral is a control cost associated with the 
increment of controls Ay (i = 1,2) in the continuous part. The last integral is a 
control cost associated with the jumps in A} , i = 1,2 (or equivalently jumps in X t/ ). 
We further extend fcs(x) outside the region R™ -1 x [/3, 7] for two continuous functions 
/3(x) < 7(x), Vx e R n_1 as the following: 

(4.6)fcs(x) = fe s (x,/3(x))+ / /i(x,u)d«, Vx- (x,x„) eR"- 1 x (-oo,/3), 



(4.7) fc 5 (x) = fc 5 (x, 7 (x))+ / / 2 (x,u)d«, Vx = (x,i n )er- 1 x( 7 ,oo) I 

and we are looking for an admissible control S such that 

(4.8) W(x) = inf fc s (x), Vx e R™, 

where § is i/ie set 0/ aZ/ admissible control policies. 
Proof. [Proof of Theorem 14.4] 
1. Consider the diffusion given in (|4.4[) with x S 5. Applying the generalized 
Ito formula to e-"*VK(X t ) (see [TO]) yields 

e~ Qt t¥(X t ) = W(x) -a [ e" as W(X s )ds + f e - as CW(X s )ds 

Jo Jo 

(4.9) 



/ e- as VW(X s ) • a(X s )dB s 
Jo 

I e- as ^-W{-K s ){dA { p' c -dA {2) ' c )+ V e~ as AW(X s ). 
Jo ox n 



0<s^t 



Using the following identity 

W(x) + ]T e~ as AW(X s ) = W(X a -) + ]T e- as AW(X s ), 

0<s^t O^s^t 
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and taking expectation of both sides of (I4.9[) with respect to P x and let t — > oo, 
we get the following: 



(a - C) W(X t )dt 



(4.10) W{x) = E : 



oo a 
-at u 



dx, 



W(X t )(dA { t 1} > c - dA? ] ' c ) 



i 0^t<oo 



Therefore 

(4.11) fcs(x)-W(x) 



[fc(X t )-(a-£)W(X t )]dt 



A(x t ) + ^-w(x t ) 
h{X t ) - ^-^(x t ) 



(i), 



<L4 



(2), 



+£ x ( Y, e- at AW(X t 

<t<oo 

E e ^ 



i 0^*<oo 



/i(X t )dy 



/ 2 (X t )dy 



By Theorem 14.11 the first three integrands in f|4. are all nonnegative for 
the process X t staying in the region S. 
Define the sets 

r+ = {t > : aa[ 1] > 0}, r_ = {t ^ : aa[ 2) > 0}, 

then r + n r_ = 4>. Rewrite the last two expectations of (|4.11j) as 



^ E e " Qt 

\ter+ 
+E X I Y 



X 



JLw(x t ) + h(x t ) 



dy 



,ter_ 



-— W(X t ) + f 2 (X t ) 



By Theorem l4.1l this quantity is nonnegative, and this shows fcs(x) ^ W'(x), Vx £ 
S. 

Due to the extension (|4.6[) . we proved fcs(x) ^ W(x), Vx £ R™. 
2. If S = R n_1 x [a, b] and the process X t is the reflecting diffusion on 5, then 
by Theorem 14. 11 the first integral in (14. lip is obviously zero. As to the second 
and third integrals in (14. lip . because dA^ ,dA^ are zero whenever X t is in 
R n_1 x (a, b), while at the boundary where A[ x \ A[ 2 ^ increases, the integrands 
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are zero, these two integrals are zero too. The last two expectations are also 
zero due to this construction hence W(x) = fcs(x),Vx G S. 
On the other hand, suppose W(k) = fcs(x), Vx G S, then all the expectations 
in (|4.1ip must be zero. Assume S = R" -1 x [j3, 7] and at least one of the 
inequalities is true: /3(x) ^ gi(5c),j(x) ^ g 2 (x), then due to the continuity of 
these four functions we know that the sum of the first three integrals in (|4.11|) 
is positive by Theorem 14. II And because the sum of the last two expectations 
in (|4.1ip is nonnegative, it can be seen that W(x) < fcs(x). Therefore in order 
to have W(x.) = k s (x), S must be the region R™ -1 x [a, b]. 
Again by Theorem 14. 11 we see that the processes X t and A^ (i = 1,2) 
must all be continuous in order to eliminate the last two expectations in 
(|4TTT|) . which implies a[ i) = A^ l)c (i = 1,2) when /3(x) = a(x),7(x) = 6(x). 
Therefore (X t , A^\ A^p) must be the reflecting diffusion on R" -1 x [a, b}. 

□ 

Remark 4.4. The possible jumps, AA^\i — 1,2, only happen at time zero. 
When the process Xt starts at a point outside the region R ra_1 x [a, b], the control brings 
it back to this region immediately, and after that, the process will be a continuous 
reflected diffusion. 

If we let 7 = (0, 0, 0, 1) T , then the reflected diffusion can be written as 

(4.12) dX t = n(X t )dt + o-(X t )dB t + -fdA { t 1} - jdA^ , t > 0, 

where A^ increases only at the boundary a and A^ 1 increases only at the boundary 
b. 

We notice that the reflection only happens to the last component of the process. 
Since the two curves a and b are smooth and uniformly Lipschitz, if we let n(x) be 
the inward normal for x at the boundary, then we can show that there exist positive 
constants v\ , vi such that 

Vx=(x,a(x)), (7,n(x)) > 
Vx= (x, 6(x)), (7,n(x)) < -v 2 . 

By a localization technique and Theorem 4.3 in |13j . it can be shown that there exists 
a unique solution (X t , Af\ A^) to the reflected diffusion (|4.12[) . This problem is 
called the Skorohod problem. 

Corollary 4.5. Under the Assumptions \3.Sl Iff. 31 and \3.4\ for /1, / 2 and the defi- 
nition for function h, the solution W G C 2 ''"' 2 (R") and the functions a(x), 6(x) 
in Theorem \4-l \ are uniquely determined. The function W(yi) (x G R") coincides with 
the optimal return function T4 7 *(x) given in 

Proof. In the proof of Theorem 14.11 we have seen that the conditions given in 
this Theorem are necessary conditions for the value function of the stochastic control 
problem (|4.8|) . and this value function as well as the functions a(x), 6(x) are uniquely 
determined. □ 

Concluding Remarks. In this paper, we studied a multi-dimensional stochastic 
singular control problem via Dynkin game and Dirichlet form. The value function 
of the Dynkin game satisfies a variational inequality problem, where we showed the 
existence of the solution, and the integrated form of this value function turns out to be 
the value function of the singular control problem. By characterizing the regularities 
of the value function of the Dynkin game and its integrated version, we showed the 
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existence of a classical solution to the Hamilton- Jacobi-Bellman equation associated 
with this multi-dimensional singular control problem, and this kind of problems were 
traditionally solved through viscosity solutions. We also proved that the optimal 
control policy is given by two curves and the controlled process is the reflected diffusion 
between these two curves. 

Acknowledgments. In memory of Dr. Michael Taksar. 
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